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Audio system having reverberation reducing filter 



The present invention relates to a system for suppressing audio distortion, 

comprising: 

echo cancelling means coupled between an audio output and a distorted 
desired sound sensing microphone array, mid 
5 a filter arrangement coupled to the echo cancelling means and/or the 

microphone array. 

The present invention also relates to a filter arrangement for application in the 
system and to a method of suppressing audio distortion. 

10 

Such a system is known from WO 97/45995. The known audio system 
comprises an adaptive echo cancelling filter for removing echoes emanating between a 
systems' loudspeaker output and a microphone. The known system has a filter arrangement 
coupled to the echo cancelling filter and the microphone for spectrally suppressing echo 

15 components in the microphone signal that were not removed by the echo cancelling filter. 
One microphone senses a desired audio signal, while the other microphones only receive 
interfering distortions of the desired signa l . The system may have a filter arrangement 
coupled to the echo cancelling means and/or the microphone array for spectrally suppressing 
distortion in the form of additional audio noise interference. 

20 It is a disadvantage of the known system that it can not effectively be used for 

also reducing reverberant distortions in a desired audio signal sensed by a microphone array. 



25 



Therefore it is an object of the present invention to provide an improved 
system and filter arrangement therein for also suppressing echo distortion in the form of echo 
tail part reverberation in an audio signal sensed by a microphone array. 
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Thereto in the system according to the invention the filter arrangement 
includes filter coefficients representing reverberation distortion in the desired audio sensed 
by the microphone array. 

The known echo cancelling means remove only a first part of the acoustic 
5 echo from the microphone array signals. The echo emanates between the audio output and 
each of the microphones, and the first part thereof generally comprises direct audio or sound 
and first room reflections. However -second part, that is- reverberant echo components are 
not removed by the echo cancelling means but are in the system according to the invention at 
least reduced by the filter arrangement, which includes filter coefficients which comprise a 
10 measure for reverberation distortion in the desired audio sensed by the microphone array. In 
addition it appeared that large microphone spacings which are not always feasible in practise 
are not required for the second part reverberation reduction to be effective. 

It is an advantage of the present invention that not only reverberant 
components of the acoustic echo emanating from the audio output, but also reverberant 
15 components of a desired audio signal sensed by the microphone array are effectively reduced 
by the system according to the present invention. 

An embodiment of the system according to the invention allowing design 
flexibility is characterised in that the filter arrangement includes a beamfoimer having at least 
a filter and sum beamformer and/or a delay and sum beamformer. 
20 Most often a combination of filter, sum and delay elements is also used to 

form the so called Generalised Sidelobe Canceller. Advantageously an additional delay 
element may be added to the filter arrangement for farther improving the performance of the 
system according to the invention. 

A further embodiment of the system according to the invention is 
25 characterised in that the filter arrangement is arranged to be adaptive to the reverberation 
distortion and/or the desired audio signal sensed by the microphone array. 

In that case the filter coefficients can be updated, to include a dynamic aspect 
in the cancelling of varying reverberation, instead of representing a more or less fixed model 
of the room. Now reverberation can also be suppressed in relation to the respective varying 
30 positions and directions of the array microphones. 

A still further embodiment of the system according to the invention is 
characterised in that the system is arranged for updating the filter coefficients in case the 
reverberation not cancelled by the echo cancelling means dominates the audio signal sensed 
by the microphone array. 
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Advantageously the filter coefficients of the filter arrangement are not updated 
when the desired audio source dominates the array sensed audio signals, thus avoiding the 
risk of unwanted distortion or even cancellation of the desired audio signal in the output of 
the filter arrangement 

5 Another embodiment of the system according to (he invention is characterised 

in that the system is arranged for updating the filter coefficients during a training session. 

In the alternative -not requiring such a training session- the system is 
characterised in that it is provided with automated filter coefficient update control means at 
least to he coupled to the filter arrangement. 
10 An elaboration of the system according to the invention is characterised in that 

the filter arrangement has an output, and that the system comprises output echo canceller 
means coupled between the filter output and the audio output. 

Any remaining reverberation not cancelled by the beanrformer or the echo 
cancelling means is now cancelled by the output echo canceller means. 
15 A further elaboration of the system according to the invention is characterised 

in that the automated filter coefficient update control means are further coupled to the output 
echo canceller means for controlling the update speed of the filter arrangement. 

The output echo cancelling means apart from cancelling remaining echoes can 
advantageously also be used to provide a measure for any remaining reverberation level in 
20 order to compare that level with the level of other sensed sound sources in order to use the 
result of the comparison as a quantity for controlling the update speed of the filter 
arrangement. 

Another further embodiment of the system according to the invention is 
characterised in that each microphone of the microphone array has its individual echo 
25 cancelling means. 

By applying individualised echo cancelling means for each microphone of the 
array any separate direct echoes and reflections in the first part of any of sensed array signals 
are cancelled individually as much as possible, while combined remaining reverberation in 
the tail part is dealt with by the filter arrangement and/or the output echo cancelling means. 

30 

At present the system and filter arrangement according to the invention will be 
elucidated further together with their additional advantages, while reference is being made to 
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the appended drawing, wherein similar components are being referred to by means of the 
same reference numerals. In the drawing: 

Fig. 1 shows an overview including possible embodiments of the system 
according to the invention; 
5 Fig. 2 shows the direct signal, the early reflections and the later arising 

reverberation tail of a typical room impulse response as a function of time; and 

Fig. 3 shows a filter arrangement embodiment according to the invention in 
the form of a generalised sidelobe canceller having an array of three microphones for 
application in an extension of the system of Fig. 1 . 

10 

Fig. 1 shows a system 1, which is suited for suppressing audio distortion in a 
desired signal. The system as shown has a loudspeaker 2 and a microphone array 3 
comprising two microphones 3-1, 3-2. An audio output signal on output 4 is reproduced by 

IS the loudspeaker 2. A near end source (not shown) generates desired speech, which is received 
by the array 3 as a desired speech signal. In addition the array 3 senses -as clarified in Fig. 2- 
as part of different kinds of distortions apart from noise, a direct signal from the loudspeaker 
2 to the array 3, echoes in the form of early -first part- reflections and after some exponential 
decay later -second part- reflections in the form of so called reverberation shown as a 

20 reverberating tail of a typical room impulse response as a function of time. Each microphone 
3-1, 3-2 may have its associated echo canceller gi, and g2 respectively coupled between the 
audio output 4 and the distorted desired audio sensing microphone array 3. If at all possible 
hardware and/or software parts of the echo cancelling means gi (i = 1, 2 for two microphones) 
may be used in common in order to save costs. Each of the echo cancellers gi simulate the 

25 path from the loudspeaker 2 to a respective microphone 3 in order to cancel the effects of at 
least the direct signal and the early reflections, that is the first part of the echo. The technique 
accomplishing that is for example known from WO 97/45995, whose disclosure is 
incorporated herein by reference thereto. The respective echo cancelling means may be 
implemented in various ways, such as with Least Mean Squares (IMS), Recursive Least 

30 Squares or Frequency Domain Adaptive Filter using Block LMS techniques. 

The respective echo cancelling means gi are coupled to two microphones 3-1, 
3-2 of the array 3 through schematically shown subtracters 5-1, and 5-2 each having outputs 
6-1, 6-2. These subtracter outputs 6-1 and 6-2 carry respective echo cancelled signals. 
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The system has a filter arrangement 7, which may include a beamformer 7B, 
which is coupled through the subtracters 5 to the echo cancelling means gi and/or to the 
microphone array 3. The beamformer 7B, which is included in a generally called Generalised 
Sidelobe Canceller, is capable of defining and controlling an audio microphone sensitivity 
5 lob or curve. Given the in this case two beamformer input signals on the subtracter outputs 6- 
1, 6-2, these signals comprise the desired audio/sound/speech signal and a reverberation 
signal originating from the reverberating tail. The beamformer 7B is capable of 
(Hscriminating the reverberation signal by deriving a primary signal z including the desired 
signal and a reference signal x which includes the reverberation. It does this here by filtering 

10 in filters ft and f 2 , as shown, and then summing in summing device 9-1 the filters outputs to 
reveal the primary signal. This way the echo cancelled microphone signals Ui and u 2 are 
added such that remaining direct signals and early reflections of the desired audio are 
coherently summed, which increases the beamformers performance. Furthermore it does this 
here by filtering the echo cancelled microphone signals in blocking filters b i and b2 and then 

15 by summing in device 9-2 the filters' outputs to reveal a reverberation representing reference 
signal x. The reference signal x virtually contains no desired signal components. The filters bi 
together B, are called the blocking matrix. The filters £ and bi carry the directional, that is the 
desired sources dependent information. These filters may also be fixed or adaptive. 

In the case as shown in Fig. 3 the beamformer 7B has one delay element 8 

20 coupled to output 10 of device 9-1 followed by a summing device 9-3. The delay element 8 
provides a non causal part to the beamformers' impulse response which appeared to improve 
its performance. The reference signal x is fed to an adaptive filter, indicated w in Fig. 1, 
whose output signal is fed to an inverting input 1 1 of device 9-3. The filter w of the filter 
arrangement 7 comprises the filter coefficients which represent or contain a measure for the 

25 reverberation -second part- distortion in the desired audio sensed by the microphone array 3. 
The summing device 9-3 also has a summed or beamformer output S used to adapt the filter 
coefficients in the adaptive filter w of the thus adaptive filter arrangement 7, such that their 
coefficient values represent the varying reverberation distortion. In a non adaptive 
embodiment the filter coefficients would be fixed to then cancel a then presumed fixed 

30 reverberation tail. 

Because the filtered reverberation or reference signal on inverting input 1 1 is 
subtracted from the primary signal in summing device 9-3 its signal on the summed output S 
only contains the desired signal, with the reverberating tail being cancelled. 
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In order to adapt or update the filter coefficients, only the reverberant 
behaviour of the room needs to taken into account Thereto the desired audio source is not 
required, as any source in the room would do that job. One possibility is to only update the 
filter coefficients if the reverberation on the audio output 4 dominates the array 3 sensed 
5 reverberation. Another possibility is to update the filter coefficients during a training session. 

In a further embodiment the system 1 comprises output echo canceller means 
g3 coupled between the beamformer output S and to the audio output 4, in this case through 
delay means 12 providing a delay of N samples corresponding with the direct signal and the 
early reflections already removed by the echo cancelling means gi. If the system 1 is provided 
10 with automated beamformer coefficient update control means 13 these means will be coupled 
to the beamformer 7 and to the output echo canceller means g3 for controlling the update 
speed of the filter w. The update speed of the filter w may for example be controlled by a 
measurement of the reverberant echo level relative to the level of other audio or sound 
sources that may be present in the room. Such measurement is preferably performed in both 
15 the time and frequency domain in order to control the update speed of the filter arrangement 
7 accordingly. 

Fig. 3 shows an embodiment of a filter arrangement 7 having an array of three 
microphones 3-1, 3-2, 3-3. Essentially a plurality of microphones is possible. However above 
outlined principles remain the same. Block matrices may be grouped into one block B. 
20 Different reference signals xi and x 2 may be fed to the filter 7A, here comprising generally 
adaptive individualised filters Wi and w 2 . At wish delay elements A may be divided up in 
front or after the filters fi, fz, and f 3 coupled to the respective three microphones 3. Separate 
delay elements A could be included in the respective branches from possibly each of the 
microphones to summing device 9-1 to account for expected individual delays between 
25 loudspeaker 2 and microphone 3. 

If the system 1 does not start up by itself, due to absence of any far end signal 
a loudspeaker signal could be generated, e.g. a noise sequence or some kind of start up tune. 

The system explained above can for example be used in hands-free 
communication systems, such as hands-free speakerphones, voice controlled systems for 
30 example in home or for medical applications, congress systems, dictation system or the like. 



i 
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CLAIMS 



1. A system (1) for suppressing audio distortion, comprising: 

echo cancelling means (gi, gz) coupled between an audio output (4) and a - 
distorted desired audio sensing microphone array (3), and 

a filter arrangement (7, 7A) coupled to the echo cancelling means (gi, g2) 
5 and/or the microphone array (3), the filter arrangement including filter (7A) coefficients (w; 
Wi, W2) representing reverberation distortion in the desired audio sensed by the microphone 
array (3). 

2. The system (1) according to claim 1, wherein the filter arrangement (7) 

10 includes a beamformer (7B) having at least a filter and sum beamformer and/or a delay and 
sum beamformer. 

3. The system (1) according to claim 1, wherein the filter arrangement (7A) is 
arranged to be adaptive to the reverberation distortion and/or the desired audio signal sensed 

15 by the microphone array (3). 

4. The system (1) according to claim 1, wherein the system (1) is arranged for 
updating the filter (7A) coefficients (w; wi, W2) in case the reverberation not cancelled by the 
echo cancelling means (gi, gz) dominates the audio signal sensed by the microphone array 

20 (3). 

5. The system (1) according to claim 1, wherein the system (1) is arranged for 
updating the filter (7A) coefficients (w; wi, W2) during a training session. 

25 6. The system (1) according to claim 1, wherein the system (1) is provided with 

automated filter coefficient update control means (13) coupled to at least the filter 
arrangement (7A). 
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7. The system (1) according to claim 1 , wherein the filter arrangement (7) has an 
output (S), and the system (1) comprises output echo canceller means (g3) coupled between 
the filter output (S) and the audio output (4). 

8. The system (1) according to claim 7, wherein the automated filter coefficient 
update control means (13) are further coupled to the output echo canceller means (§3) for 
controlling the update speed of the filter arrangement (7). 

9. The system (1) according to claim 1, wherein each microphone (3-i, i = 1, 2, 
n) of the microphone array (3) has its individual echo cancelling means (gi, i = 1, 2, n). 

10. A filter arrangement (7) for use in the system (1) according to any one of the 
claims 1-9. 
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ABSTRACT: 



A system 1 is described which is suited for suppressing audio distortion. The 
system comprises echo cancelling means gi, g2 coupled between an audio output 4 and a 
distorted desired audio sensing microphone array 3, and a filter arrangement 7 coupled to the 
echo cancelling means gi, gz and/or the microphone array 3. The filter arrangements' 
coefficients represent reverberation distortion in the desired audio sensed by the microphone 
array (3). 
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